User profiles’ image clustering for digital investigations

Sharing images on Social Network (SN) platforms is one of the most widespread behaviors which may cause privacy-intrusive and illegal content to be widely distributed. Clustering the images shared through SN platforms according to the acquisition cameras embedded in smartphones is regarded as a significant task in forensic investigations of cybercrimes. The Sensor Pattern Noise (SPN) caused by camera sensor imperfections due to the manufacturing process has been proved to be an effective and robust camera fingerprint that can be used for several tasks, such as digital evidence analysis, smartphone fingerprinting and user profile linking as well. Clustering the images uploaded by users on their profiles is a way of fingerprinting the camera sources and it is considered a challenging task since users may upload different types of images, i.e., the images taken by users’ smartphones (taken images) and single images from different sources, cropped images, or generic images from the Web (shared images). The shared images make a perturbation in the clustering task, as they do not usually present sufficient characteristics of SPN of their related sources. Moreover, they are not directly referable to the user’s device so they have to be detected and removed from the clustering process. In this paper, we propose a user profiles’ image clustering method without prior knowledge about the type and number of the camera sources. The hierarchical graph-based method clusters both types of images, taken images and shared images. The strengths of our method include overcoming large-scale image datasets, the presence of shared images that perturb the clustering process and the loss of image details caused by the process of content compression on SN platforms. The method is evaluated on the VISION dataset, which is a public benchmark including images from 35 smartphones. The dataset is perturbed by 3000 images, simulating the shared images from different sources except for users’ smartphones. Experimental results confirm the robustness of the proposed method against perturbed datasets and its effectiveness in the image clustering

Are Social Networks Watermarking Us or Are We (Unawarely) Watermarking Ourself?

In the last decade, Social Networks (SNs) have deeply changed many aspects of society, and one of the most widespread behaviours is the sharing of pictures. However, malicious users often exploit shared pictures to create fake profiles leading to the growth of cybercrime. Thus, keeping in mind this scenario, authorship attribution and verification through image watermarking techniques are becoming more and more important. In this paper, firstly, we investigate how 13 most popular SNs treat the uploaded pictures, in order to identify a possible implementation of image watermarking techniques by respective SNs. Secondly, on these 13 SNs, we test the robustness of several image watermarking algorithms. Finally, we verify whether a method based on the Photo-Response Non-Uniformity (PRNU) technique can be successfully used as a watermarking approach for authorship attribution and verification of pictures on SNs. The proposed method is robust enough in spite of the fact that the pictures get downgraded during the uploading process by SNs. The results of our analysis on a real dataset of 8,400 pictures show that the proposed method is more effective than other watermarking techniques and can help to address serious questions about privacy and security on SNs.Comment: 43 pages, 6 figure

Are Social Networks Watermarking Us or Are We (Unawarely) Watermarking Ourself?

In the last decade, Social Networks (SNs) have deeply changed many aspects of society, and one of the most widespread behaviours is the sharing of pictures. However, malicious users often exploit shared pictures to create fake profiles, leading to the growth of cybercrime. Thus, keeping in mind this scenario, authorship attribution and verification through image watermarking techniques are becoming more and more important. In this paper, we firstly investigate how thirteen of the most popular SNs treat uploaded pictures in order to identify a possible implementation of image watermarking techniques by respective SNs. Second, we test the robustness of several image watermarking algorithms on these thirteen SNs. Finally, we verify whether a method based on the Photo-Response Non-Uniformity (PRNU) technique, which is usually used in digital forensic or image forgery detection activities, can be successfully used as a watermarking approach for authorship attribution and verification of pictures on SNs. The proposed method is sufficiently robust, in spite of the fact that pictures are often downgraded during the process of uploading to the SNs. Moreover, in comparison to conventional watermarking methods the proposed method can successfully pass through different SNs, solving related problems such as profile linking and fake profile detection. The results of our analysis on a real dataset of 8400 pictures show that the proposed method is more effective than other watermarking techniques and can help to address serious questions about privacy and security on SNs. Moreover, the proposed method paves the way for the definition of multi-factor online authentication mechanisms based on robust digital features

A new 3D modelling paradigm for discrete model

Until few years ago, 3D modelling was a topic confined into a professional environment. Nowadays technological innovations, the 3D printer among all, have attracted novice users to this application field. This sudden breakthrough was not supported by adequate software solutions. The 3D editing tools currently available do not assist the non-expert user during the various stages of generation, interaction and manipulation of 3D virtual models. This is mainly due to the current paradigm that is largely supported by two-dimensional input/output devices and strongly affected by obvious geometrical constraints. We have identified three main phases that characterize the creation and management of 3D virtual models. We investigated these directions evaluating and simplifying the classic editing techniques in order to propose more natural and intuitive tools in a pure 3D modelling environment. In particular, we focused on freehand sketch-based modelling to create 3D virtual models, interaction and navigation in a 3D modelling environment and advanced editing tools for free-form deformation and objects composition. To pursuing these goals we wondered how new gesture-based interaction technologies can be successfully employed in a 3D modelling environments, how we could improve the depth perception and the interaction in 3D environments and which operations could be developed to simplify the classical virtual models editing paradigm. Our main aims were to propose a set of solutions with which a common user can realize an idea in a 3D virtual model, drawing in the air just as he would on paper. Moreover, we tried to use gestures and mid-air movements to explore and interact in 3D virtual environment, and we studied simple and effective 3D form transformations. The work was carried out adopting the discrete representation of the models, thanks to its intuitiveness, but especially because it is full of open challenges

Automatic Speech Classifier for Mild Cognitive Impairment and Early Dementia

none5noThe World Health Organization estimates that 50 million people are currently living with dementia worldwide and this figure will almost triple by 2050. Current pharmacological treatments are only symptomatic, and drugs or other therapies are ineffective in slowing down or curing the neurodegenerative process at the basis of dementia. Therefore, early detection of cognitive decline is of the utmost importance to respond significantly and deliver preventive interventions. Recently, the researchers showed that speech alterations might be one of the earliest signs of cognitive defect, observable well in advance before other cognitive deficits become manifest. In this article, we propose a full automated method able to classify the audio file of the subjects according to the progress level of the pathology. In particular, we trained a specific type of artificial neural network, called autoencoder, using the visual representation of the audio signal of the subjects, that is, the spectrogram. Moreover, we used a data augmentation approach to overcome the problem of the large amount of annotated data usually required during the training phase, which represents one of the most major obstacles in deep learning. We evaluated the proposed method using a dataset of 288 audio files from 96 subjects: 48 healthy controls and 48 cognitively impaired participants. The proposed method obtained good classification results compared to the state-of-the-art neuropsychological screening tests and, with an accuracy of 90.57%, outperformed the methods based on manual transcription and annotation of speech.mixedBertini, Flavio; Allevi, Davide; Lutero, Gianluca; Montesi, Danilo; Calzà, LauraBertini, Flavio; Allevi, Davide; Lutero, Gianluca; Montesi, Danilo; Calzà, Laur

GASTon: A Graph-Exploration System for Indexing, Annotating and Visualizing PubMed Articles to Enhance the Analysis of Social deTerminants of Health

Many works have shown associations between social determinants of health (SDoH) –the social circumstances in which people live– and health-related outcomes. However, the lack of SDoH data increases the challenges in measuring and understanding their effect on people’s health and health systems. In this paper, we present GASTon, a system for the indexing, annotation, and graph-based rendering of PubMed information to enable the search and retrieval of SDoHs in scientific literature. Our work provides a way to associate specific concepts with peer-reviewed articles to simplify the search for social factors. It builds a knowledge graph based on PubMed publications and associates them with concepts extracted from the Unified Medical Language System (UMLS) Metathesaurus. GASTon allows a full-text search and graph-based navigation and supports an overview of the concepts and related publications. Moreover, the architecture allows scale-up thanks to its containerized nature and parallelizat ion capabilities. The system is open-source under the Apache V2 license

Unraveling pedestrian mobility on a road network using ICTs data during great tourist events

Tourist flows in historical cities are continuously growing in a globalized world and adequate governance processes, politics and tools are necessary in order to reduce impacts on the urban livability and to guarantee the preservation of cultural heritage. The ICTs offer the possibility of collecting large amount of data that can point out and quantify some statistical and dynamic properties of human mobility emerging from the individual behavior and referring to a whole road network. In this paper we analyze a new dataset that has been collected by the Italian mobile phone company TIM, which contains the GPS positions of a relevant sample of mobile devices when they actively connected to the cell phone network. Our aim is to propose innovative tools allowing to study properties of pedestrian mobility on the whole road network. Venice is a paradigmatic example for the impact of tourist flows on the resident life quality and on the preservation of cultural heritage. The GPS data provide anonymized georeferenced information on the displacements of the devices. After a filtering procedure, we develop specific algorithms able to reconstruct the daily mobility paths on the whole Venice road network. The statistical analysis of the mobility paths suggests the existence of a travel time budget for the mobility and points out the role of the rest times in the empirical relation between the mobility time and the corresponding path length. We succeed to highlight two connected mobility subnetworks extracted from the whole road network, that are able to explain the majority of the observed mobility. Our approach shows the existence of characteristic mobility paths in Venice for the tourists and for the residents. Moreover the data analysis highlights the different mobility features of the considered case studies and it allows to detect the mobility paths associated to different points of interest. Finally we have disaggregated the Italian and foreigner categories to study their different mobility behaviors

Nature-based solutions for hydro-meteorological hazards: revised concepts, classification schemes and databases

Hydro-meteorological hazards (HMHs) have had a strong impact on human societies and ecosystems. Their impact is projected to be exacerbated by future climate scenarios. HMHs cataloguing is an effective tool to evaluate their associated risks and plan appropriate remediation strategies. However, factors linked to HMHs origin and triggers remain uncertain, which poses a challenge for their cataloguing. Focusing on key HMHs (floods, storm surge, landslides, droughts, and heatwaves), the goal of this review paper is to analyse and present a classification scheme, key features, and elements for designing nature-based solutions (NBS) and mitigating the adverse impacts of HMHs in Europe. For this purpose, we systematically examined the literature on NBS classification and assessed the gaps that hinder the widespread uptake of NBS. Furthermore, we critically evaluated the existing literature to give a better understanding of the HMHs drivers and their interrelationship (causing multi-hazards). Further conceptualisation of classification scheme and categories of NBS shows that relatively few studies have been carried out on utilising the broader concepts of NBS in tackling HMHs and that the classification and effectiveness of each NBS are dependent on the location, architecture, typology, green species, environmental conditions as well as interrelated non-linear systems. NBS are often more cost-effective than hard engineering approaches used within the existing systems, especially when taking into consideration their potential co-benefits. We also evaluated the sources of available data for HMHs and NBS, highlighted gaps in data, and presented strategies to overcome the current shortcomings for the development of the NBS for HMHs. We highlighted specific gaps and barriers that need to be filled since the uptake and upscaling studies of NBS in HMHs reduction is rare. The fundamental concepts and the key technical features of past studies reviewed here could help practitioners to design and implement NBS in a real-world situation

A New Orbiting Deployable System for Small Satellite Observations for Ecology and Earth Observation

In this paper, we present several study cases focused on marine, oceanographic, and atmospheric environments, which would greatly benefit from the use of a deployable system for small satellite observations. As opposed to the large standard ones, small satellites have become an effective and affordable alternative access to space, owing to their lower costs, innovative design and technology, and higher revisiting times, when launched in a constellation configuration. One of the biggest challenges is created by the small satellite instrumentation working in the visible (VIS), infrared (IR), and microwave (MW) spectral ranges, for which the resolution of the acquired data depends on the physical dimension of the telescope and the antenna collecting the signal. In this respect, a deployable payload, fitting the limited size and mass imposed by the small satellite architecture, once unfolded in space, can reach performances similar to those of larger satellites. In this study, we show how ecology and Earth Observations can benefit from data acquired by small satellites, and how they can be further improved thanks to deployable payloads. We focus on DORA—Deployable Optics for Remote sensing Applications—in the VIS to TIR spectral range, and on a planned application in the MW spectral range, and we carry out a radiometric analysis to verify its performances for Earth Observation studies